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^ ' We first give a strong limit law for the empirical degree distribution, and then have a closer 
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terms of large and moderate deviation principles. Using these results, we expose an inter- 
esting phase transition: in cases of strong preference of large degrees, eventually a single 
vertex emerges forever as vertex of maximal degree, whereas in cases of weak preference, 
the vertex of maximal degree is changing infinitely often. Loosely speaking, the transition 
between the two phases occurs in the case when a new edge is attached to an existing vertex 
with a probability proportional to the root of its current degree. 

Keywords. Barabasi-Albert model, sublinear preferential attachment, dynamic random 
graphs, maximal degree, degree distribution, large deviation principle, moderate deviation 
principle. 

2000 Mathematics Subject ClassiGcation. Primary 05C80 Secondary 60C05 90B15 



1 Introduction 

1.1 Motivation 

Dynamic random graph models, in which new vertices prefer to be attached to vertices with 
higher degree in the existing graph, have proved to be immensely popular in the scientific 
literature recently. The two main reasons for this popularity are, on the one hand, that these 
models can be easily defined and modified, and can therefore be calibrated to serve as models for 
social networks, collaboration and interaction graphs, or the web graph. On the other hand, if 
the attachment probability is approximately proportional to the degree of a vertex, the dynamics 
of the model can offer a credible explanation for the occurrence of power law degree distributions 
in large networks. 

The philosophy behind these preferential attachment models is that growing networks are built 
by adding nodes successively. Whenever a new node is added it is linked by edges to one or more 
existing nodes with a probability proportional to a function / of their degree. This function /, 
called attachment rule, or sometimes weight function, determines the qualitative features of the 
dynamic network. 

The heuristic characterisation does not amount to a full definition of the model, and some 
clarifications have to be made, but it is generally believed that none of these crucially influence 
the long time behaviour of the model. 

It is easy to see that in the general framework there are three main regimes: 

• the linear regime, where f{k) x k; 

• the superlinear regime, where f{k) ^ k; 

• the suhlinear regime, where f{k) <^ k. 

The linear regime has received most attention, and a major case has been introduced in the 
much-cited paper Barabasi and Albert (1999). There is by now a substantial body of rigorous 
mathematical work on this case. In particular, it is shown in BoUobas et al. (2001), Mori (2002) 
that the empirical degree distribution follows an asymptotic power law and in Mori (2005) that 
the maximal degree of the network is growing polynomially of the same order as the degree of 
the first node. 

In the superlinear regime the behaviour is more extreme. In Oliveira and Spencer (2005) it is 
shown that a dominant vertex emerges, which attracts a positive proportion of all future edges. 
Asymptotically, after n steps, this vertex has degree of order n, while the degrees of all other 
vertices are bounded. In the most extreme cases eventually all vertices attach to the dominant 
vertex. 

In the linear and sublinear regimes Rudas et al. (2007) find almost sure convergence of the 
empirical degree distributions. In the linear regime the limiting distribution obeys a power law, 
whereas in the sublinear regime the limiting distributions are stretched exponential distributions. 
Apart from this, there has not been much research so far in the sublinear regime, which is the 
main concern of the present article, though we include the linear regime in most of our results. 



Specifically, we discuss a preferential attachment model where new nodes connect to a random 
number of old nodes, which in fact is quite desirable from the modelling point of view. More pre- 
cisely, the node added in the nth step is connected independently to any old one with probability 
f{k)/n, where k is the (in-)degree of the old node. We first determine the asymptotic degree 
distribution, see Theorem 1.1, and find a result which is in line with that of Rudas et al. (2007). 
The result implies in particular that, if f{k) = (k + 1)" for ^ a < 1, then the asymptotic 
degree distribution (/x^) satisfies 

log^fc TT^^^"", 

showing that power law behaviour is limited to the linear regime. Under the assumption that 
the strength of the attachment preference is sufficiently weak, we give very fine results about the 
probability that the degree of a fixed vertex follows a given increasing function, see Theorem 1.10 
and Theorem 1.12. These large and moderate deviation results, besides being of independent in- 
terest, play an important role in the proof of our main result. This result describes an interesting 
dichotomy about the behaviour of the vertex of maximal degree, see Theorem 1.7: 

• The strong preference case: If ^^ l//(n)^ < oo, then there exists a single dominant vertex 
-called persistent hub- which has maximal degree for all but finitely many times. However, 
only in the linear regime the number of new vertices connecting to the dominant vertex is 
growing polynomially in time. 

• The weak preference case: If J2n ^/ fi^)'^ = °o, then there is almost surely no persistent 
hub. In particular, the index, or time of birth, of the current vertex of maximal degree 
is a function of time diverging to infinity in probability. In Theorem 1.15 we provide 
asymptotic results for the index and degree of this vertex, as time goes to infinity. 

A rigorous definition of the model is given in Section 1.2, and precise statements of all the 
principal results follow in Section 1.3. At the end of that section, we also give a short overview 
over the further parts of this paper. 

1.2 Definition of the model 

We now explain how precisely we define our preferential attachment model given a monotonically 
increasing attachment rule f: {0,1,2,...} — > (0, cxd) with f{n) ^ n -|- 1 for all n G Z-|_ : = 
{0, 1, . . .}. At time n = 1 the network consists of a single vertex (labeled 1) without edges and 
for each n G N the graph evolves in the time step n ^ n + 1 according to the following rule 

• add a new vertex (labeled n + 1) and 

• insert for each old vertex m a directed edge n + 1 ^ m with probability 

/(indegree of m at time n) 
n 

The new edges are inserted independently for each old vertex. Note that the assumptions 
imposed on / guarantee that in each evolution step the probability for adding an edge is smaller 
or equal to 1. Formally we are dealing with a directed network, but indeed, by construction, all 
edges are pointing from the younger to the older vertex, so that the directions can trivially be 
recreated from the undirected (labeled) graph. 



There is one notable change to the recipe given in Krapivsky and Redner (2001): We do not 

add one edge in every step but a random number, a property which is actuahy desirable in most 

applications. Given the graph after attachment of the nth vertex, the expected number of edges 

added in the next step is 

1 " 

— 2, f (indegree of m at time n) . 

m=l 

This quantity converges, as n ^ cx) almost surely to a deterministic limit A, see Theorem 1.1. 
Moreover, the law of the number of edges added is asymptotically Poissonian with parameter A. 
Observe that the outdegree of every vertex remains unchanged after the step in which the 
vertex was created. Hence our principal interest when studying the asymptotic evolution of 
degree distributions is in the indegrees. 

1.3 Presentation of the main results 

We denote by Z[m, n], for m, n G N, m ^ n, the indegree of the m-th vertex after the insertion 
of the n-th vertex, and by Xfc(n) the proportion of nodes of indegree k £ Z_|_ at time n, that is 



1 " 



^^^ {Z[i,n]=k}- 
i=l 



Moreover, denote HkiiT-) = EX^.(n), X{n) = (Xk{n) : k G Z+), and /u(n) = {^^{n) : A; G Z^ 
Theorem 1.1 (Asymptotic empirical degree distribution). 
(i) Let 



which is a sequence of probability weights. Then, almost surely, 

lim X{n) = /i 

n— >oo 

in total variation norm. 

(a) If f satisfies f{k) ^ rjk + \ for some rj G (0,1), then the conditional distribution of the 
outdegree of the (n + l)st incoming node (given the graph at time n) converges almost 
surely in variation topology to the Poisson distribution with parameter A : = (/i, /) . 

Remark 1.2. The asymptotic degree distribution coincides with that in the random tree model 
introduced in Krapivsky and Redner (2001) and studied by Rudas et al. (2007), if / is chosen 
as an appropriate multiple of their weight function. This is strong evidence that these models 
show the same qualitative behaviour, and that our further results hold mutatis mutandis for 
preferential attachment models in which new vertices connect to a fixed number of old ones. 

Example 1.3. Suppose f{k) ~ 7A;", for < a < 1 and 7 > 0, then a straight forward analysis 

yields that 

fe+i 

1=1 

Hence the asymptotic degree distribution has stretched exponential tails. 



In order to analyse the network further, we scale the time as well as the way of counting the 
indegree. To the original time n G N we associate an artificial time 

n— 1 ^ 

^(n) := > — ~ logn, 
Z — / rn. 



m 

m=l 



and to the original degree j G Z+ we associate the artificial degree 

i-i 



*"'-^M' 



fc=0 

An easy law of large numbers illustrates the role of these scalings. 

Proposition 1.4 (Law of large numbers). For any fixed vertex labeled m G N, we have that 

^(Z\m,n]) 
lim — -— = 1 almost surely. 

n^oo W(n) 

Remark 1.5. Since ^(n) ~ logn, we conclude that for any m G N, almost surely, 

^{Z[m,n]) ~ logn as n ^ oo. 

In particular, we get for an attachment rule / with /(n) ~ 'yn and 7 G (0, 1], that <I>(n) ~ - log n 
which implies that 

log Z[m,n] ~ logn'*', almost surely. 

Furthermore, an attachment rule with f{n) ~ 771° for a < 1 and 7 > leads to 

1 
Z[m, n] r^ (7(1 — a) log n) i-^ . 

We denote by T := {^(n) : n G N} the set of artificial times, and by S := {^{j) '■ j G Z-|_} the 
set of artificial degrees. From now on, we refer by time to the artificial time, and by (in-)degree 
to the artificial degree. Further, we introduce a new real-valued process (Z[s, t])sgT,t^o via 

Z[s, t] := ^{Z[m, n]) if s = ^(m), t = ^(n) and m ^ n, 

and extend the definition to arbitrary t by letting Z[s, t] := Z[s, sVmax(Tn[0, t])]. For notational 
convenience we extend the definition of / to [0, 00) by setting f{u) := f{\_u\) for all u G [0, 00), 
and linearly interpolate $ at the breakpoints S so that 



r 1 

Jo f{v) 



We denote by £[0, cx)) the space of cadlag functions x: [0, 00) -^ M endowed with the topology 
of uniform convergence on compact subsets of [0, cx)). 

Proposition 1.6 (Central limit theorem). In the case of weak preference, for all s G T, 

'Z[s,s + iplt] -ifl 






in distribution on £[0, 00), where {Wt'. t '^ 0) is a standard Brownian motion and {(Pt)t^o is the 
inverse of i(pt)t^o given by 

,$-i(t) I 

W) 



Vt= I T7-X2 ^'^- 



Our main result describes the behaviour of the vertex of maximal degree, and reveals an inter- 
esting dichotomy between weak and strong forms of preferential attachment. 

Theorem 1.7 (Vertex of maximal degree). Suppose f is concave. Then we have the following 
dichotom^y: 



Strong preference. // 



oo ^ 






kTW''"' 



then with probability one there exists a persistent hub, i.e. there is a single vertex which 
has maximal indegree for all but finitely many times. 



Weak preference. // 



oo ^ 



then with probability one there exists no persistent hub and the time of birth, or index, of 
the current hub tends to infinity in probability. 

Remark 1.8. Without the assumption of concavity of /, the assertion remains true in the weak 
preference regime. In the strong preference regime our results still imply that, almost surely, 
the number of vertices, which at some time have maximal indegree, is finite. 

Remark 1.9. In the weak preference case the information about the order of the vertices is 
asymptotically lost: as a consequence of the proof of Theorem 1.7, we have for two nodes s < s' 
in T that 

lim F{Z[s,t] > Z[s',t]) = i 

t^oo 

a phenomenon reminiscent of propagation of chaos. Conversely, in the strong preference case, 
the information about the order is not lost completely and one has 

l[mF{Z[s,t] > Z[s',t]) > i 

t^oo 

Investigations so far were centred around typical vertices in the network. Large deviation princi- 
ples, as provided below, are the main tool to analyse exceptional vertices in the random network. 
Throughout we use the large-deviation terminology of Dembo and Zeitouni (1998) and, from 
this point on, the focus is on the weak preference case. 

Our aim is to determine the typical age and indegree evolution of the hub. For this purpose we 
assume that 

• / is regularly varying with index ^ a < 2, 

• for some r/ < 1, we have f{j) ^ r]{j + 1) for all j G Z+. 

We set / := / o $^1, and recall from Lemma A.l in the appendix that we can represent / as 
f{u) = u°''y^^°^i I{u) for u > 0, where ^ is a slowly varying function. We denote by X[0, 00) the 
space of nondecreasing functions x: [0, cxd) -^ M with x(0) = endowed with the topology of 
uniform convergence on compact subintervals of [0, cxd). 



Theorem 1.10 (Large deviation principles). Under assumption (1), for every s GT, the family 
of functions 

'-Z\s,s + Kt]: t ^ O] 

satisfies large deviation principles on the space X[0, cx)), 

1 _ 

• with speed (k !-"£(«;)) and good rate function 

/q°° xl^" [I — xt + xt log xt] dt if X is absolutely continuous, 
oo otherwise. 

• and with speed (k) and good rate function 

T^i \ l"/(0) ifxt = {t-a)+forsomea^O, 
K{x) = < 

I oo otherwise. 

Remark 1.11. The large deviation principle states, in particular, that the most likely deviation 
from the growth behaviour in the law of large numbers is having zero indegree for some (unusually 
long) time, and after that time typical behaviour kicking in. 

More important for our purpose is a moderate deviation principle, which describes deviations on 
a finer scale. Similar as before, we denote by C{0, oo) the space of cadlag functions x : (0, oo) -^ M 
endowed with the topology of uniform convergence on compact subsets of (0,oo), and always 
use the convention xq := liminf^io xt. 

Theorem 1.12 (Moderate deviation principle). Suppose (1) and that (a^) is regularly varying, 
so that the limit 

2ct-l _ 

c := lim Ok k i-« £{k) G [0, oo) 

KfoO 
l-2a - _l 

exists. If K^-'^" 1{k) 2 <C Ok ^ K, then, for any s G T, the family of functions 

Z\s, S + Hit] — Kt \ 

Ok / K>0 

2a-l _ 

satisfies a large deviation principle on £(0, oo) with speed {af. k i-« ^(k)) and good rate function 

J, \ _ \ \ /o°°(^t)^ ^^^^ "^^ ~ c /(^) ^0 if X is absolutely continuous and xq ^ 0, 
\ oo otherwise, 

where we use the convention 1/0 = oo. 

Remark 1.13. If c = oo there is still a moderate deviation principle on the space of functions 
x: (0, oo) -^ M with the topology of pointwise convergence. However, the rate function I, which 
has the same form as above with l/oo interpreted as zero, fails to be a good rate function. 

Remark 1.14. Under assumption (1) the central limit theorem of Proposition 1.6 can be stated 
as a complement to the moderate deviation principle: For a^ ~ K'^-'^"i{n) 2 ^ we have 

' z\s,s + Kt] — Kt \ / n~~^^r 

See Section 2.1 for details. 



Our final result describes weak limit laws for index and degree of the vertex of maximal degree. 
This result relies on the moderate deviation principle above. 

Theorem 1.15 (Limit law for age and degree of the vertex of maximal degree). Suppose f 
is regularly varying with index a < ^. Define s^ to be the index of the hub at time t, and 
^max _ _^[5*^f] Iq f)g ffiQ corresponding maximal indegree. One has, in probability, 

* 7max , 1 1 - a t^^ 1 l-a t 

St ^ Zi — t 



21 -2a e{t) 21 -2a f{t) 
Moreover, in probability on C{0,oo), 

/ Zlst , si + tu] — tu \ /i „/ i-2c , 

Remark 1.16. In terms of the natural scaling, we get for the index m* of the hub and the 
maximal indegree 2^^^ at natural time n G N that, in probability. 



logm; 
and 



1 1 — a (log n) 1- 
21 -2a £(log n) 



^^^^-$-i(^(n)) ~ ^logn. 

'■'■'" 21 -2a 

The remainder of this paper is devoted to the proofs of these results. Rather than proving the 
results in the order in which they are stated, we proceed by the techniques used. Section 2 is 
devoted to martingale techniques, which in particular prove the law of large numbers. Propo- 
sition 1.4, and the central limit theorem. Proposition 1.6. We also prove a property of the 
martingale limit which is crucial in the proof of Theorem 1.7. Section 3 is using Markov chain 
techniques and provides the proof of Theorem 1.1. In Section 4 we collect the large deviation 
techniques, proving Theorem 1.10 and Theorem 1.12. Section 5 combines the various techniques 
to prove our main result. Theorem 1.7, along with Theorem 1.15. An appendix collects the 
auxiliary statements from the theory of regular variation. 



2 Martingale techniques 

In this section we identify a martingale associated with the degree evolution of a vertex, and 
study its properties. This will be a vital tool in the further analysis of the network. 

2.1 Martingale convergence 

Lemma 2.1. Fix s G T and represent Z[s, ■] as 

Z[s,t] = t- s + Mf. 



Then {Mt)t£T,t ^ s is a martingale. Moreover, the martingale converges if and only if 



du < oo, (2) 

f{ur 



and otherwise it satisfies the following functional central limit theorem: Let 

Jo f{vy Jo f{v) 

and denote by (p* : [0, cxd) -^ [0, oo) the inverse of (ft); then the martingales 

M« := (J-Ms+^A forK>0 

converge in distribution to standard Brownian motion as k tends to infinity. In any case the 
processes (- Z[s, s + Kt])tj.o converge, as k^ oo, almost surely, in C[0, oo) to the identity. 

Proof. For t = ^(n) G T we denote by At the distance between t and its right neighbour in T, 
i.e. 

At = - = ^ -, , , . 3) 

One has 

E[Z[s,t + At] - Z[s,t] [Gn] =E[^oZ[i,n+l] -^oZ[i,n] | a„] 

^ f{Z[i,n]) ^^^ 1 _1_ 

n /(^[j,n]) n 

Moreover, 

(M)i+At - (M)i = (l - f{Z[s, t])At) - [ At ^ ] At. (4) 

Observe that by Doob's martingale inequahty and the uniform boundedness of f{-)~^ one has 

._ JE[sup^ ^ t ^ ^+2'+i \Mt\^] ^ r<- 
(2^2 log 2*)^ «^ 

where C = C(/(0)) is a constant only depending on /(O). Moreover, by Chebyshev, one has 



sup 



I '-I ^1 1 ^ \ TID/ „ t 



i > s 



+2« \/t-slog(t - S) ^ f:^ ^s+2fe=£t=Ss+2fe+i (i - S) log (t - S) 



-^1) ^ Vp( sup ^H ^1 



k=i 
oo , ^^2 °^ 

< OO. 



^ VeT sup %, 1 ^ Vofc 

tr^ L^+2'=^J^s+2'= + l (i - S) log (t - S)J ^ 

Letting i tend to infinity, we conclude that almost surely 



limsup— ^ — u ^ ^ ^- ^^' 

t^oo yt — siog[t - S) 



In particular, we obtain almost sure convergence of {-Z[s,s + Kt])t^o to the identity. As a 
consequence of (4), for any e > 0, there exists a random almost surely finite constant ij = r]{uj,e) 
such that, for all i ^ s, 

'^"'<r /(^-'((l-eW) ^'' + "- 

Note that $ : [0, oo) -^ [0, oo) is bijective and substituting (1 — e)K,u by ^{v) leads to 

^ |.<J>-i((l-e)(t-s)) J ^ |.$-i(t-s) ^ 



Thus, condition (2) implies convergence of the martingale (Mj). 

We now assume that ((/^t)* ^ o converges to infinity. Since e > was arbitrary the above estimate 

implies that 

limsup ^ 1, almost surely. 

t^oo '-Pt-s 

To conclude the converse estimate note that ^tefi^^)"^ < cxd so that we get with (4) and (5) 
that 

(M)t ^ / -r, TT-, ^ — TT du — 71 ^ / „, ,„ dv — ?7, 

for an appropriate finite random variable rj. Therefore, 

lim = 1 almost surely. (6) 

The jumps of M" are uniformly bounded by a deterministic value that tends to zero as k tends 
to oo. By a functional central limit theorem for martingales (see, e.g.. Theorem 3.11 in Jacod 
and Shiryaev (2003)), the central limit theorem follows once we establish that, for any f ^ 0, 

lim {M'^)t = t in probability, 

which is an immediate consequence of (6). D 

Proof of Remark 1.14. We suppose that / is regularly varying with index a < 2- By the 
central limit theorem the processes 

(yr : t ^ 0) := f ^!fll±^kt^ , , ^ O) for ^ > 

converge in distribution to the Wiener process (Wt) as k tends to infinity. For each k > we 
consider the time change (T/^)f^o '■= {'■Pki/^k)- Using that 99 is regularly varying with parameter 
^f^ we find uniform convergence on compacts: 

l-2ct 

{T^) -^ (t 1-" ) =: (rj) as k ^ 00. 
Therefore, 

a£i£±^ : o 0) = (y;| : 0) ^ (»■,:«> 0)^ 

Y^V?(k) ^ 

1 1 — 2a — _| 

and, as shown in Lemma A.l, ip,^ ~ i-2a '^ ^"" £(k)~ . D 



10 



2.2 Absolute continuity of the law of Moo 

In the sequel, we consider the martingale {Mt)t^s,t<=T given by ^[s,t] — {t — s) for a fixed s G T 
in the case of strong preference. We denote by M^q the limit of the martingale. 

Proposition 2.2. // / is concave, then the distribution of M^o is absolutely continuous with 
respect to Lebesgue measure. 

Proof. For ease of notation, we denote Yt = Z[s,t], for t £ T, t ^ s. Moreover, we fix c > 
and let At denote the event that Y^ G [u — c,u + c] for all u G [s, t] n T. 
Now observe that for two neighbours V- and f in S 

nyt+At = V- At) = (1 - /» At) nYt = v, At) + />_) AtF{Yt = v^;At). (7) 

Again we use the notation At = ^-\(t) ■ Moreover, we denote Af{v) = f{v) — f{v^). In the first 
step of the proof we derive an upper bound for 

h{t) = maxP(yt = v; At) for t G T, t ^ s. 

ties 

With (7) we conclude that 

nYt+At = V- At) ^ (1 - M{v) At) h{t). 

For w ^ we denote ?(w) = maxS n [0, w\. Due to the concavity of /, we get that 

h{t + At) < (1 - A/(?(t + c + 1)) At) h{t). 

Consequently, 

Kt)^ n (l-A/(?(n + c+l))Au) 

Me[s,t)nT 

and using that log(l + x) ^ a; we obtain 

/i(t)^exp(^- Y, A/(c^(u + c+l))An). (8) 

ue[s,t)r\T 

We continue with estimating the sum S in the latter exponential: 

S= Y, Afi<u + c+l))Au^ f Af{c;{u + c+l))du. 
u£[s,t)nT "^* 



Next, we denote by /^™ the continuous piecewise linear interpolation of /Ino- Analogously, we 
1 



set <I>'™(t;) = Jq Tmrpr (in and f^"^{v) = /^™ o (<I)^™) ^{v). Using again the concavity of / we 



conclude that 

ft rt 



I Af{<;{u + c + l))du;^ I (/"'^)'($-i(n + c + 1)) du, 

J s J s 

and that 

f"' ^ f => $'"' ^ $ ^ ($li°)-i ^ $-1 ^ (/l"i)' o ($l"i)-i ^ (/li°)' o $-1. 

11 



Hence, 

S^ f (f^y{<^-\u + c+l))du^ / (/"'^)'o($l-)-i(u + c+l)dn. 

J s J s 

For Lebesgue almost all arguments one has 

so that 

(/l-)'o(c|.l-)-l = li-l = (log/l-)'. 

Consequently, 



S ^ log /i*°(t + c + 1) - log /'"^(s + c + 1) 
Using that /'"^ ^ / and ($l"i)-i ^ $-1 we finally get that 

S^ log/(t + c+l)-logc*, 
where c* is a positive constant not depending on t. Plugging this estimate into (7) we get 

^^"/(t + c + 1) 
Fix now an interval / C M of finite length and note that 

P(Mi G /; At) = FiYt £ t - s + I; At) i^ #[{t - s + I) nSn At] ■ h{t). 



Now (t — s + I) n §> n At is a subset of [t — c,t + c] and the minimal distance of two distinct 
elements is bigger than jTrri- Therefore, i^[{t — s + /) n S n At] ^ |/| f{t + c) + 1, and 

F{MteI;At)^c*\I\+ f 

fit + c) 

Moreover, for any open and thus immediately also for any arbitrary interval / one has 

P(Moo G I;Aoo) < liminfP(Mi G I; At) ^ c* \I\, 

t— >oo 

where A^o = Pltefs oo)nT ^t- Consequently, the Borel measure fic on M given by fJ-c{E) = E[l^^ • 
1e{Moo)], is absolutely continuous with respect to Lebesgue measure. The distribution fi of 
Moo, i-e. /"(-E) = E[l£;(Moo)], can be written as monotone limit of the absolutely continuous 
measures fie (c G N), and it is thus also absolutely continuous. D 

3 The empirical indegree distribution 

In this section we prove Theorem 1.1. For k G Z4. and n G N let /Ufc(n) = E[Xfc(n)] and 
fj,{n) = {nk{n))k<=z+- We first show that (^(n))„gN converges to ^ = {fik)kez+ as n tends to 
infinity. We start by deriving a recursive representation for fi{n). For k G Z_|_, 

1 " 

E[Xfc(n+ l)\X{n)] = -——{^E^-l{Z[i,n]=k<Z[i,n+l]} + '^{Z[i,n]<k=Z[i,n+l]} X{n) 



i=l 



1 



n + 1 



nXk{n) + t{k=o} 
f{k) , ^ , J{k 



Xk{n) -\ —- -nXk{n) h nXk-i{n) Xk{n) + l{k=Q} 



n n 



12 



Thus the hnearity and the tower property of conditional expectation gives 

lik{n + 1) = fik{n) H —r{f{k - l)fik-i{n) - (1 + f{k))iXk{t) + hk=Q})- 

Now defining Q G M^^^ as 

\ 

1 -fffl) + l) fil) 

Q 



/-/(o) /(o) 

1 -(/(1) + 1) /(I) 

1 -(/(2) + l) /(2) 



V ■■ 



(9) 
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and conceiving /u(n) as a row vector we can rewrite the recursive equation as 



fi{n + l) =^(n) / + 



n+ 1 



Q], 



where / = ((5i,j)i,j(=N denotes the unit matrix. Next we show that // is a probabihty distribution 
with nQ = 0. By induction, we get that 

1=0 1=0 ' -^ w 

for any k € Z+. Since ^^=9°= ^//(O ^ Si^o -'^/(^ + 1) = 00 it follows that /i is a probability 
measure on Z_|_. Moreover, it is straight-forward to verify that 

00 
f{0)no = 1-/^0 = X]w 



1=1 



and that for all k G 



fik-l)fik-i = il + f{k))fik, 



hence fj,Q = 0. 

Now we use the matrices P^"^' := I + ^^^^j- Q to define an inhomogeneous Markov process. The 

entries of each row of P^""' sum up to 1 but (as long as / is not bounded) each P*-"-* contains 

negative entries. Nonetheless one can use the P^"'' as a time inhomogeneous Markov kernel as 

long as at the starting time m G N the starting state I G Z_|_ satisfies I ^ m — 1. 

We denote for any admissible pair l,m by {Yn"^)n ^m a Markov chain starting at time m in 

state I having transition kernels {P^"'')n ^ m- Due to the recursive equation we now have 

^fc(n)=P(yy = fc). 

Next, fix fe G Z_|_, let m > A; arbitrary, and denote by u the restriction of fi to the set {m,m + 
1, . . . }. Since lu, is invariant under each P^"'' we get 



m— 1 



IJ'k 



(^P(") . . . P("))fc = J^ W IP(>^n ™ = k) + {vP^""^ ...P 



(n)- 



k- 



1=0 
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Note that in the n-th step of the Markov chain, the probabihty to jump to state zero is ^-rj for 
ah original states in {1, . . . ,n — 1} and bigger than ^^^^ for the original state 0. Thus one can 
couple the Markov chains (1^'™) and (Yn' ) in such a way that 

^l^n+1 — ^n+1 — '■-'l ^n T '- n ) — n+1 ' 

and that once the processes meet at one site they stay together. Then 

n— 1 

p(yi'™ = Y^) ^ 1 - J] -^ -^ 1. 

i=m 

Thus (zyp(™) . . . P("))fc € [0, fi{[m, cx)))] implies that 



m— 1 

lim sup 






As m — > oo we thus get that 

lim fikin) = Hk- 



In the next step we show that the sequence of the empirical indegree distributions (X(n))„gf^ 
converges almost surely to fi. Note that nXk{n) is a sum of n independent Bernoulli random 
variables. Thus Chernoff's inequality (Chernoff (1981)) implies that for any t > 

¥{nXk{n) ^ n(E[Xfc(n)] -t)) ^ e""*'/(2E[X,{n)]) ^ g-nt2/(2/.,{n))^ 
Since 

oo 
^g-ntV(2Mfe(n))<oO, 
n=l 

Borel-Cantelli implies that almost surely liminf„^oo Xk{n) ^ ^k for all k G Z-|-. This establishes 
almost sure convergence of {X{n)) to ^. 

We still need to show that the conditional law of the outdegree of a new node converges almost 
surely in the weak topology to a Poisson distribution. In the first step we will prove that, for 
r/ G (0, 1), and the affine linear attachment rule f{k) = r]k + l, one has almost sure convergence 
of y„ := ^ Ylm=i ^["^) "■] = (^(^)5 id) to y := 1/(1 — 77). First observe that 

n n 

Yn+l = ^ [nYn + Y, ^^[^^ ^]] =^n + ^ [-Yn + Y, AZ[m, n]] , 

m=l m=l 

where AZ[m,n] := Z[m,n + 1] — Z[m,n]. Given the past J^n of the network formation, each 
A^[m, n] is independent Bernoulli distributed with success probability -{r]Z[m,n\ + 1). Con- 
sequently, 

n 

E[y„+i|.F„] = Yn + Trri[-^n + Y h(v2[m,n] + 1)] 

m=l 



Yn + ^,[-{l-7l)Yn + l], 
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and 

n 

(y)„+i - {Y)n^j^ Y. kiv2[m,n] + 1) = j^^i^Yn + 1]. (10) 

m=l 

Now note that due to Theorem 1.7 (which can be used here, as it will be proved independently 
of this section) there is a single node that has maximal indegree for all but finitely many times. 
Let m* denote the random node with this property. With Remark 1.5 we conclude that almost 
surely 

log2^[?T2*,n] ~ logn''. (11) 

Since for sufficiently large n 



1 " 
Yn = — 2, Z[m,n\^Z[m*,n\, 



n 

m=l 



equations (10) and (11) imply that (Y). converges almost surely to a finite random variable. 
Next, represent the increment l^+i — 1^ as 

Yn+i -Yn = ^[-il- v)Yn + l] + AM„+i, (12) 

where AMn+i denotes a martingale difference. We shall denote by (M„)„gN the corresponding 
martingale, that is M„ = X]m=2 ^^m- Since (Y). is convergent, the martingale (M„) converges 
almost surely. Next, we represent (12) in terms oi Yn = Yn — y as the following inhomogeneous 
linear difference equation of first order: 

Yn+1 = (l-i^)F„ + AM„+i. 

The corresponding starting value is Yi =Yi — y = —y, and we can represent its solution as 

n 

Yn = -yhi+Y,^Mmh^ 

for 

I if n < m 



nr=m+i(l-V) if^^"i- 



K 

III" / 1 i_ 

Setting A/i™ = /i™ — /i™"^ we conclude with an integration by parts argument that 

n n n n n 

Y, AM™ h^=Y, AM™(l - Y ^^n) =Mn-Y E ^^™ ^^n 
m=2 m=2 k=m+l m=2 k=m+l 

n k—1 n 

fc=3 m=2 fc=3 



(13) 



15 



Note that /i™ and A/i™ tend to as n tends to infinity so that X]fc=m+i '^^n = 1 ~ ^JT tends 
to 1. With Moo '■= lini„^oo Mn and Em = sup„>„j |M„ — Moo| we derive for m ^ n 

m n 

fc=3 k=m+l 

m n n 

^ |M„-Moo| + J]|Mfc_i|A/i^ + | ^ (Moo-Mfc_i)A/i^| + (l- J^ A/i^)|Moo|. 

f^ fc=3 fe=m+l A;=?Tt+l 



Since hmm— >oo £m = 0, almost surely, we thus conclude with (13) that X]m=2 AMm, h"^ tends to 
0. Consequently, lim„_^oo Yn = y, almost surely. Next, we show that also {fi, id) = y. Recall 
that n is the unique invariant distribution satisfying fiQ = (see (9) for the definition of Q). 
This implies that for any A; G N 

f{k - 1) Hk-i - {f{k) + 1) ^fc = 0, or equivalently, ^ik = f{k - 1) iik-i - f{k) Hk 
Thus 

oo oo 

(/") id) = ^ /c /Ufe = ^ A; [f{k - 1) Hk-i - f{k) ^ik] ■ 
fc=i fe=i 

One cannot split the sum into two sums since the individual sums are not summable. However, 
noticing that the individual term f{k)fikk ~ k'^fJ'k tends to 0, we can rearrange the summands 
to obtain 

oo 

ifi, id) = /(O) fio + Yl /(^) /"fe = (/"' /) = '?(^' id) + 1- 
fc=i 

This implies that {fi, id) = y and that for any m G N 

{X{n), l[m,oo) • id) = (X(n),id) - {X{n), Ijo,™) • id) -^ {^i, ]l[„,oo) • id), almost surely. 

Now, we switch to general attachment rules. We denote by / an arbitrary attachment rule 
that is dominated by an affine attachment rule f^. The corresponding degree evolutions will 
be denoted by {Z[m^n]) and {Z^[m^n]), respectively. Moreover, we denote by ^ and /n* the 
limit distributions of the empirical indegree distributions. Since by assumption / ^ f^, one can 
couple both degree evolutions such that 2^[m,n] ^ Z^[m^n] for all n ^ m ^ 0. Now 

(X(n), /) ^ (X(n), l[o,„) • /) + (X^(n), l[„,oo) • D 

so that almost surely 

limsup(X(n), /) ^ (/i, l[o,„) • /) + (;U^ l[„,oo) • D- 

n— »oo 

Since m can be chosen arbitrarily large we conclude that 

limsup(X(n),/) ^ {^l,f)■ 
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The converse estimate is an immediate consequence of Fatou's lemma. Hence, 

n 

lim ErVAZ[m,n].FJ =(/x,/). 



m=l 



Since, conditional on Tn^ X]m=i ^^I"^'*^] ^^ ^ ^^^^ °f independent Bernoulli variables with 
success probabilities tending uniformly to 0, we finally get that >C(^^^j^ lS.Z\m^ n]|.7>i) converges 
in the weak topology to a Poisson distribution with parameter (/i, /). 

4 Large deviations 

In this section we derive tools to analyse rare events in the random network. We provide large 
and moderate deviation principles for the temporal development of the indegree of a given vertex. 
This will allow us to describe the indegree evolution of the node with maximal indegree in the 
case of weak preferential attachment. The large and moderate deviation principles are based on 
an exponential approximation to the indegree evolution processes, which we first discuss. 

4.1 Exponentially good approximation 

In order to analyze the large deviations of the process Z[s, •] (or Z\m^ ■, ]) we use an approxi- 
mating process. We first do this on the level of occupation measures. For s G T and ^ u < v 
we define 

Ts[u, v) = sup{t' — t : Z[s, t] ^ u, Z[s, t'] < v, t, t' £ T} 

to be the time the process Z[s, ■] spends in the interval [u, v). Similarly, we denote by Ts[u] the 
time spent in u. Moreover, we denote by (T[u])„g§ a family of independent random variables 
with each entry T[u] being Exp(/(M))-distributed, and denote 

T[u, v) := J2 ^M fo^ all ^ u ^ ?;. 

The following lemma shows that T[u,v) is a good approximation to Ts[u,v) in many cases. 

Lemma 4.1. Fix rji G (0, 1), /et s G T and denote by r the entry time into u of the process 
Z[s,-]. One can couple (Ts[u])ues c,nd {T[u])ues such that, almost surely, 

hf-iu)Ar^r„}\Ts[u] - T[u]\ ^ (1 V V2f{u))Ar, 

where rj2 is a constant only depending on rji. 

Proof. We fix t G T with f{u)At ^ rji. Note that it suffices to find an appropriate coupling 
conditional on the event {r = t}. Let L'^ be a uniform random variable and let F and F denote 
the (conditional) distribution functions of T[u] and Ts[u], respectively. We couple T[u] and Ts[u] 
by setting T[u\ = F~^{U) and Ts[u\ = F~^{U), where F~^ denotes the right continuous inverse 
of F. The variables T[u] and Ts[u] satisfy the assertion of the lemma if and only if 

F{v-{l\/ri2f{u))At) i^F{v) ^F{v + {l\/ri2f{u))At) for all w ^ 0. (14) 
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We compute 

1 - F{v) = n (1 - f{u)Aw) = exp Yl log (^ " /(«)^^) 

Next observe that, from a Taylor expansion, for a suitably large r/2 > 0, we have —f{u)Aw 
r]2 f{uf[Aw]^ < log (l - f{u)Aw) ^ - f{u)Aw, so that 

1- F{v) i: exp(-f{u) Y^ Aw) i^ exp{- f{u){v- At)) = 1- F{v-At). 

t^w,w+Aw^t+v 

wGT 

This proves the left inequality in (14). It remains to prove the right inequality. Note that 



1 - F{v) ^ exp(- Yl (/»^«^ + V2 huflAw]' 



wGT 



and 

[At] 



y [Aw]^^ y i-^-_l — <:At. 

^ ^ ^ ^ m^ At -1 - 1 



wGT 

Consequently, 1 - F{v) ^ exp{-/(ti)(t; + r]2f{u)At)} = 1- F{v + r]2f{u)At). D 

As a direct consequence of this lemma we obtain an exponential approximation. 
Lemma 4.2. Suppose that, for some ij < 1 we have f{j) ^ ri{j + 1) for all j G Z-|-. If 

~( 

j=0 

then for each s G T one can couple Tg with T such that, for all A ^ 0, 



> yr TT7T < OO, 



P(sup|rs[0,u) -T[0,u)| ^ A + \/2K) ^4e"2if, 

where K > is a finite constant only depending on f . 

Proof. Fix s G T and denote by r^ the first entry time of Z\s, •] into the state u G S. We couple 
the random variables T\vi\ and Ta\u\ as in the previous lemma and let, for w G S, 

M, = Y (^4^] - ^N) = Ts%^) - T%v). 

Then (M^)^gg is a martingale. Moreover, for each v = ^(j) G S one has r^, ^ ^(j + 1) so that 
Atv ^ 1/(j + 1). Consequently, using the assumption of the lemma one gets that 

At, fiv) ^ -^fij) =: c, ^ 7? < 1. 
J + 1 
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Thus by Lemma 4.1 there exists a constant rj' < oo depending only on /(O) and rj such that the 
increments of the martingale (M^) are bounded by 

By assumption we have K := X^j,g§ c^ < oo an we conclude with Lemma A. 4 that for A ^ 0, 

P(sup|T^[0,u)-T[0,M)| ^ X + V2K) ^4e~w. 

D 
We define {Zt)t ^ o to be the S-valued process given by 

Zt := max{w G S : r[0, v) ^ t}, (15) 

and start by observing its connection to the indegree evolution. 
Corollary 4.3. In distribution on the Skorokhod space, we have 

lim(Z[s, s + t])t > = iZt)t ^ 0- 

s'\oo 

Proof. Recall that Lemma 4.1 provides a coupling between (Ts[n])„g§ and (T[n])„g§ for any 
fixed s G T. We may assume that the coupled random variables {Ts[u])ues and (T [n])„gs are 
defined on the same probability space for all s G T (though this does not respect the joint 
distributions of {Ts[u])u£S for different values of s G T). Denote by {Z[s, •])s<^T and (Zt) the 
corresponding processes such that Ts[0,u) + s = s + J2v<u'^s['i'] and ^^[O,^) = X]„<uT'[f] are 
the entry times of {Z[s,s + t]) and {Zt) into the state n G S. By Lemma 4.1 one has that, 
almost surely, lim^^oo ^s [0, w) = T[0,u) and therefore one obtains almost sure convergence of 
{Z[s, s + t])t^o to {Zt)t^o in the Skorokhod topology. D 

Proposition 4.4. Uniformly in s, the processes 

• i^Z^t ■■ t ^ 0)k>o and {^Z[s, s + Kt]: t ^ 0)k>o; 

• {-^{Z^t - Kt): f^ 0)k>o and {-^{Z[s, s + Kt] - Kt): t '^ 0)k>o, 

are exponentially equivalent on the scale of the large, respectively, moderate deviation principles. 

Proof. We only present the proof for the first large deviation principle of Theorem 1.10 since 
all other statements can be inferred analogously. 

We let Us{x) denote the open ball around x G I[0, oo) with radius 5 > in an arbitrarily fixed 
metric d generating the topology of uniform convergence on compacts, and, for fixed rj > 0, 
we cover the compact set K = {x & X[0, oo): I{x) ^ rj} with finitely many balls (Us{x))x(zi, 
where I G K. Since every x G I is continuous, we can find e > such that for every x G I and 
increasing and right continuous r : [0, oo) -^ [0, oo) with |r(t) — t| ^ e, 

y G Us{x) => y^(.) G U25{x). 

For fixed s G T we couple the occupation times (Ts[0, 'u))„g§ and (T[0,u))„g§ as in Lemma 4.2, 
and hence implicitly the evolutions {Z[s,t])t^s and {Zf)t^Q. Next, note that Z[s,s + •] can be 
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transformed into Z. by applying a time change r with |T(t) — t| ^ sup„gg |Ts[0, u) — r[0, u)|. 
Consequently, 

and an application of Lemma 4.2 gives a uniform upper bound in s, namely 

limsupsup^ — logP(d(iZ[s,s + K-],iZ^.) ^3(5) ^ - r?. 

Since r] and 5 > were arbitrary this proves the first statement. D 

4.2 The large deviation principles 

By the exponential equivalence, Proposition 4.4, and (Dembo and Zeitouni, 1998, Theorem 4.2.13) 
it suffices to prove the large and moderate deviation principles in the framework of the expo- 
nentially equivalent processes (15) constructed in the previous section. 

The first step in the proof of the first part of Theorem 1.10, is to show a large deviation principle 
for the occupation times of the underlying process. Throughout this section we denote 

a^ := k1/(^-°)^(k). 

We define the function ^: M ^ (— oo, oo] by 

t/ ^ [logT^ if u< 1, 
I oo otherwise. 

Its Legendre-Fenchel transform is easily seen to be 

^,.^y_ jt-l-logt ift>0. 

Lemma 4.5. For fixed ^ u < v the family {-T[ku, kv))k>o satisfies a large deviation principle 
with speed (a^) and rate function A* ,^(t) = sup^gig[tC — ^u,v{C)]? where 

KAC)= rs^^(C^-°/(^-"))ds. 



Proof. For fixed u < v denote by I^ = !«'" = {j £ ^+: ^(j) £ [ku,kv)}. We get, using {Sj] 
for the underlying sequence of Exp(/(j))-distributed independent random variables. 



A«(0) := logEe^^I''"'''^)/^ 

5:iogEei-. = j:iog-4^= j: e 
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where !« = ¥k'^' = {Jj^zi^l^ij), *^(i+l))- Now choose 6 in dependence on k asOn = (i^^ '^'£{k) 
with C <«"/(!-"). Then 






ds 

Note that milf^/K and supIr/k approach the values u and v, respectively. Hence, we conclude 
with the dominated convergence theorem that one has 



=Au,i.(C) 

as K tends to infinity. Now the Gartner-Ellis theorem implies the large deviation principle for 
the family {T[ku,kv))k>o for < u < u. It remains to prove the large deviation principle for 
u = 0. Note that 



ET[0,KV)=EJ2S, = I_ f{^-\t))j^^^^dt 



var(T[0, kv)) = J^ var(5,) = ^ /($-i(t))-^_2__ dt < j^^kv. 

Consequently, ^ ''^'^' converges in probability to e. Thus for t < v 

iT[0, Kv) ^t)^ ^(^T[0, ke) ^ (1 + e)e) ^(^T[Ke, Kv)^t-{1 + e)e 



and for sufficiently small e > 

liminf — logPfiT[0,Ki;) ^t) ^ - A* ^(t - (1 + e)e), 

while the upper bound is obvious. D 

The next lemma is necessary for the analysis of the rate function in Lemma 4.5. It involves the 
function ip defined as iplt) = 1 — t + tlogt for t ^ 0. 

Lemma 4.6. For fixed < xq < xi there exists an increasing function rj: M-|- -^ M-|- with 
lim^jo % = such that for any u,v £ [xo,xi] with 5 := v — u > and all w £ [u,v],t > one 
has 



A* 



(t)-u;T^tV(i)|^%(5 + tV'(i))- 



We now extend the definition of A* continuously by setting, for any u ^ and t ^ 0, 

Aluit)=uT^t. 

For the proof of Lemma 4.6 we use the following fact, which can be verified easily. 
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Lemma 4.7. For any ( >0 andt>0, we have \C{Ct)-C{t)\ ^ 2|C- 1| + | logCI +2|C- l|r(*)- 
Proof of Lemma 4.6. First observe that 

a 

75 := sup (v/u) 1-" 

xo<u<v<xi 
v—u ^ 5 

tends to 1 as 5 tends to zero. By Lemma 4.7, there exists a function {fis)s>o with lims^Qfjs = 
such that for all (" G [1/75, 75] and t > 

ir(ct)-r(t)K%(i+r(t)). 

Consequently, one has for any 6 > 0, xq < w,w < xi with |ti; — it)| ^ (5 and ( £ [1/75, 75] that 

where c < 00 is a constant only depending on xo,a;i and a. Thus for an appropriate function 
{m)5>o with hm^io % = one gets 

IwT^CiCt) - wT^C{t)\ ^ r/5(l + r (i))- (16) 

Fix xq < u < V < xi and set 5 := v — u. We estimate, for 6* ^ 0, 

and the reversed inequalities for ^ ^ 0. Consequently, 

A;„(<5t)=sup[0t-A„,^(^)] 
e 

e e 

Since (w/u)°'^^^"' and (u/f )"'^"'^~"' lie in [1/75,75] we conclude with (16) that for w G [u,v) 

K,vm ^ w^e{t)s + vs{i + e{t))d. 

To prove the converse inequality, observe 

Now note that the first partial Legendre transform can be replaced by the full one if t ^ (u/f )"'^~°) . 
Analogously, the second partial Legendre transform can be replaced if t ^ (t;/u)°(^^"'. Thus 
we can proceed as above if t (1/75,75) and conclude that 

The latter estimate remains valid on (I/75, 75) if x" " (^(1/75) V^*(75)) ^ m. Since 75 tends 
to 1 and ^*(1) = one can make r]i, a bit larger to ensure that the latter estimate is valid and 
lim5|o ^<5 = 0. This establishes the statement. D 

As the next step in the proof of Theorem 1.10 we formulate a finite-dimensional large deviation 
principle, which can be derived from Lemma 4.5. 
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Lemma 4.8. Fix = to < ti < ■ ■ ■ < tp. Then the vector 

satisfies a large deviation principle in {0 ^ ai ^ ■ ■ ■ ^ a^} C M^ with speed a^ and rate function 

p 
J{ai, ...,ap) = ^ Aaj_,,a,(*i - *i-i)> with ao := . 

i=i 

Proof. First fix = ao < ai < • • • < Op. Observe that, whenever Sj-i < Sj with sq = 0, 

P(i Z^t, ^aj>^ Z,,^ for j £{!,... ,p}) 

^ P(sj — Sj-i < ^T[aj-iK, ttjn) ^ tj — tj-i for j G {1, . . . ,p}) . 

Moreover, supposing that < tj — tj_i — {sj — Sj_i) ^ (5 for a (5 > 0, we obtain 

P(aj ^ j:Z^t, <aj + e for j G {1, . . . ,p}) 

^ P(i Z^t^. '^ aj > ^ Zt,s, and T[ajK, (oj + e)^) ^ 5 for j G {1, . . . ,p}) 

By Lemma 4.5, given e > and yl > 0, we find 5 > such that, for k large, 

P(ir[ajK, (aj^e)K) < b) ^ g-^"-^. 

Hence, for sufficiently small b we get with the above estimates that 

liminf — logP(aj + e > \Zf,t, ^ Oj for j G {1, . . . ,1)}) 

^ liminf — logP(sj — Sj_i < -T[aj_iK, Ojk) ^ tj — tj_i for j G {1, . . . ,p}) 
p 

Next, we prove the upper bound. Fix = ao ^ ... ^ flp and = 6o ^ • • • ^ ^p with a^ < bj, 
and observe that by the strong Markov property of (Zt), 

¥{b,>^Z^t, >ajfoTJe{l,...,p}) 
p 
= ll^{bj > ^ Z^t^ ^aj\h>\ Z^t^ ^ a, for i g {1, . . . ,i - 1}) 

i=i 
p 

Consequently, 

1 ^ 

limsup — logP(6j > i Z«;t^. ^ Oj for j G {1, . . . ,p}) ^ - ^ r^, 
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where 

''Kj^i,a, ih - *i-i) if «i - ^i-i ^ h - *i-i' 

^a,-i,fe, (*i - *i-l) if ^i - Oj-l ^ *i - *i-l' 

0, otherwise. 

Using the continuity of (n, v) h^ A* ^(t) for fixed t, it is easy to verify continuity of each rj of the 
parameters aj_i, aj, fcj-i, and 6j. Suppose now that (oj) and (bj) are taken from a predefined 
compact subset of W^. Then we have 

p 
X] ki ~ ^aj-i:% (*i ~ *i-i) I ^ ^( max{6j - a^ : j = 1, . . . , p}) , 
i=i 

for an appropriate function t9 with Hm^io ^i^) = 0. Now the upper bound follows with an 
obvious exponential tightness argument. D 

We can now prove a large deviation principle in a weaker topology, by taking a projective limit 
and simplifying the resulting rate function with the help of Lemma 4.6. 

Lemma 4.9. On the space of increasing functions with the topology of pointwise convergence 
the family of functions 

satisfies a large deviation principle with speed (a^) and rate function J. 

Proof. Observe that the space of increasing functions equipped with the topology of pointwise 
convergence can be interpreted as projective limit of the spaces {0 ^ ai ^ • • • ^ ap} with 
the canonical projections given by 7r(x) = {x{ti), . . . ,x{tp)) for < ti <...< tp. By the 
Dawson-Gartner theorem, we obtain a large deviation principle with good rate function 

p 
J{x)= sup ^K{t,_^),x{tAih-ti-i)- 

Note that the value of the variational expression is nondecreasing, if additional points are added 
to the partition. It is not hard to see that J{x) = oo, if x fails to be absolutely continuous. 
Indeed, there exists (5 > and, for every n G N, a partition (5 ^ s" < t" ^ • • • ^ s^ < i^ ^ ^ 
such that Y.'j=i *i - 4 ^ but ^"^^ xit"]) - x{sf) ^ 6. Then, for any A > 0, 



J(x) = sup Yl ^3 ih - h-l) - ^x{t,^,),x{tj)(.^3) 
0<ti<...<tp , 

^ IZ "^(*i "^i)+ / u^ log {I + \u^)du 

,-_i Jx(s^) 



n 



^ - A ^ (tj" - s]) + 6^ log (1 + X6^) — > S^ log (1 + X6^) , 
which can be made arbitrarily large by choice of A. 
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From now on suppose that x is absolutely continuous. The remaining proof is based on the 
equation 

J»= sup X:(t,-t,-i)x(t,)i^V(^^^f^f^^^). (17) 

Before we prove its validity we apply (17) to derive the assertions of the lemma. For the lower 
bound we choose a scheme < t" < • • • < tn, with p depending on n, such that tn — > oo and the 
mesh goes to zero. Define, for t^_i ^ t < t^, 

„,,^ 1 /■*? . , X{t])-X{t]_,) 



] \ ' j.n j.n I * j-n j-n 



Note that, by Lebesgue's theorem, x^(t) -^ xt almost everywhere. Hence 

J{x) ^ liminf / x^-" tp{x]{t)) dt^ x^-" liminf V'(a;^(t)) dt = J{x). 



n— »oo /n ^ J ' f n— >oo 



For the upper bound we use the convexity of ip to obtain 



Hence 



ti , 1 />t 



a;(t,)-x(t,_i)x _^ / 1 Z-*^ ^ X ^ 1 



'J 



J(x) ^ 

0<t 



sup ^^x(tj)i~^ / ipl^xt) dt = J{a 



as required to complete the proof. 

It remains to prove (17). We fix t' and t" with t' < t" and x{t') > 0, and partitions t' = t^ < 

• • • < f^ = t" with 5n '■= supj xit'j) — x{t^_i) converging to 0. Assume n is sufficiently large such 

that r]s„ ^ ^{t )i-" , with r/ as in Lemma 4.6. Then, 

n 

2^^x{t"_i),x{tp(*i - *j-i) 



i=i 



1 , « rA .a;(t")-x(t" i), „ ,1 (18) 



(*) 

and (*) is uniformly bounded as long as J{x) is finite. On the other hand also the finiteness of 
the right hand side of (17) implies uniform boundedness of (*). Hence, either both expressions 
in (17) are infinite or we conclude with Lemma 4.6 that for an appropriate choice of t^, 

p n 

t —t(i<---<t-p—t -^ -^ 

A. ^ « /X(t")-X(e ,)• 



sup E (*^- - *^-i) ^(i.)^ V'^''^*''^ " ""^''-'^ 



\2 

i'=io<-<tp=t"^ ' ■' -^ "' ^ ■" 'V tj-tj_i 



i=i 
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This expression easily extends to formula (17). D 

Lemma 4.10. The level sets of J are compact in 2[0,oo). 

Proof. We have to verify the assumptions of the Arzela-Ascoli theorem. Fix 6 £ (0, 1), t ^ 0, 
and a function x G T[0, oo) with finite rate J. We choose 6' G (0,(5) with x^+^z = 2{xt + Xt+s), 
denote e = xt+s — xt, and observe that 

rt+5 



/t+O a 

Xs'" [1- Xs + Xs log is] ds 

a /^t-\-S 

^^^ Jt+5' 



6-6' 



Here we used that Xg ^ e/2 for s £ [t + 6' ,t + 6]. Next, we apply Jensen's inequality to the 
convex function -0 to deduce that 

Now assume that § ^ (5. Elementary calculus yields 

If we additionally assume e ^ 2e6^ , then we get (J(a:)/log(5^2)i~" ^ s. Therefore, in general 

/ / J(x) \i-a i\ 

xt+5 - Xt ^ max 2 -] ,2ed2 . 

^ Hog6~2^ ' 

Hence the level sets are uniformly equicontinuous. As xq = for all x G X[0, od) this implies 
that the level sets are uniformly bounded on compact sets, which finishes the proof. D 

We now improve our large deviation principle to the topology of uniform convergence on compact 
sets, which is stronger than the topology of pointwise convergence. To this end we introduce, 
for every m G N, a mapping /„ acting on functions x: [0, oo) ^ M by 

!mix)t = Xt, if t^. := i ^ t < 2±1 =: t,^^. (19) 

Lemma 4.11. For every 5 > and T > 0, we have 

lim limsup — logP( sup \fm{^Z^.) - ^Z^t] > 6) = -oo. 

Proof. Note that 

Tm 

P( sup \f„,{lz..)^-lz.,\^6)^Y.^{}:Z.t,^,-^^Z^t,>6). 

By Lemma 4.9 we have 

limsup — log IP (^ Z^t,+i - -^ Z^tj > (5)^ inf { J(x) : xt^^-^ - xt^ ^ 6}, 
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and, by Lemma 4.10, the right hand side diverges to infinity, uniformly in j, as m | cx). D 

Proof of the first large deviation principle in Theorem 1.10. We apply (Dembo and 
Zeitouni, 1998, Theorem 4.2.23), which allows to transfer the large deviation principle from the 
topological Hausdorff space of increasing functions with the topology of pointwise convergence, to 
the metrizable space T[0, oo) by means of the sequence fm of continuous mappings approximating 
the identity. Two conditions need to be checked: On the one hand, using the equicontinuity of 
the sets {I{x) ^ 77} established in Lemma 4.10, we easily obtain 

limsup sup d[fm{x),x) =0, 

for every ?7 > 0, where d denotes a suitable metric on X[0, 00). On the other hand, by Lemma 4.11, 
we have that (/^(--^k-)) ^^^ ^ family of exponentially good approximations of (-Z^.). □ 

The proof of the second large principle can be done from first principles. 

Proof of the second large deviation principle in Theorem 1.10. For the lower bound 
observe that, for any T > and e > 0, 

P( sup |iZ«j - (t - a)+| < e) ^ F{Z^a = O) P( sup |i(Z«i - Z«„) - (t - a)\ < e), 

and recall that the first probability on the right hand side is exp{— Ka/(0)} and the second 
converges to one, by the law of large numbers. For the upper bound note first that, by the first 
large deviation principle, for any e > and closed set A C {J{x) > e}, 

limsup- logP(iZK. e A) = -00. 

Note further that, for any 6 > and T > 0, there exists e > such that J(x)^e implies 
supo^t^T \x — y\ < S, where yt = {t — a)+ for some a G [0, T\. Then, for 6 < /(O), 

P( sup |iZ,i -y\<^6)^ F{Z^a ^ 5k) = P(r[0, k6] ^ Ko) ^ e-«"^ ff Eexp {OSA 



e '""' exp 






and the result follows because the sum on the right is bounded by a constant multiple of n5. D 

4.3 The moderate deviation principle 

Recall from the beginning of Section 4.2 that it is sufficient to show Theorem 1.12 for the ap- 
proximating process Z defined in (15). We initially include the case c = 00 in our consideration, 
and abbreviate 

2a -1 - a - 

so that we are looking for a moderate deviation principle with speed a^b^. 
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Lemma 4.12. Let ^ u < v, suppose that f and a^ are as in Theorem 1.12 and define 

Ju 

Then the family 

'T[ku, kv) — k{v — u)) 



K>0 

satisfies a large deviation principle with speed {a^h^) and rate function 



J^+2 



I[u,v){t) 



[u,v') 



1 



t2 i/u>0 ort^ij[o,,)/(0), 

/(O) t - iX[o,.)(^ /(O))' z/n = and t ^ ij^,,) /(O). 



Proof. Denoting by A^ the logarithmic moment generating function of h^ {T[ku, kv) — k{v — u)), 
observe that 

A^{e) = logEexp{eb^{T[KU,Kv) - k{v - u))} = ^ logE exp {eb^ {T[w])} -Onb^iv-u) 

= E ^{-Wy) - ^^^- {v-u)= j /»e(i^) dw - enb^ (v - u), (20) 

where I^ = {w ^ : l{w) G [ku,kv)} and i{w) = maxS n [0,tt;]. Since ku ^ inf I^ < 
KU + (/(O))"-*^ and kv ^ supl^ < kv + (/(0))~^ we get 

Now focus on the case u > 0. A Taylor approximation gives ^{w) = ti; + 2 (1 + o{l))w'^, as tt; J, 0. 
By dominated convergence, 



^«(^)-/[^»<l^)-^^^]H^w (^^) 



Jk ^f{w)^ 2 Ji^ f{w) 



~ = / w 1-" dvu X 6'^bt 



1^ .2 



1- 02 



2 ^(k 
/, ir 

Together with (21) we arrive at 

Ak{6) ~ aKbK^'I[u,v)d^- 

Now the Gartner-Ellis theorem implies that the family ({T[ku, Kv) — K{v—u))/af^) satisfies a large 
deviation principle with speed {aj}^) having as rate function the Fenchel-Legendre transform of 

\'I[u,v)^'^ which is ^u,v)- 

Next, we look at the case u = 0. If ^ ^ ^ /(O) then Ak(0) = 00 for all k > 0, so assume the 
contrary. The same Taylor expansion as above now gives 

28 



as w 1 oo. In particular, the integrand in (20) is regularly varying with index —j^ > — 1 and 
we get from Karamata's theorem, see e.g. (Bingham et al., 1987, Theorem 1.5.11), that 

l-2a 

2 i{K) Jo 2 ' ' ' 

Consequently, 

K^oo CkOk \(X) otherwise. 

The Legendre transform of the right hand side is 

'■• \l/(0)t-lX[„,„,(l/(0))" ift>i%„,/(0). 

Since I[o^v) is not strictly convex the Gartner-Ellis Theorem does not imply the full large deviation 
principle. It remains to prove the lower bound for open sets (i, oo) with t ^ iX|o^t,)/(0). Fix 
£ £ (0, u) and note that, for sufficiently large k, 

¥{{T[ku,kv) - Kv)/a^ >t)^ F{{T[Ke,Kv) - ^(t; -e))/a« > ij[o,^)/(0)) 

X P((T(0,Ke) - Ate)K > -e) P{T[0]/a, > t - i J[o,,)/(0) +£). 

^ V ' 

so that by the large deviation principle for ((Tr^e^Kt,) — n{v — e))/afi) and the exponential distri- 
bution it follows that 

liminf J-logP((r[0,H - '^v)/a^ > t) ^ - ^^^["^^^^"^^ - (t - i J[o,.)/(0) + e)i /(O). 

Note that the right hand side converges to — -f[o,t)) {t) when letting e tend to zero. This establishes 
the full large deviation principle for ((T[0, kv) — Kv)/ai^). D 

We continue the proof of Theorem 1.12 with a finite-dimensional moderate deviation principle, 
which can be derived from Lemma 4.12. 

Lemma 4.13. Fix = to < ti < ■ ■ ■ < tp. Then the vector 

satisfies a large deviation principle in W^ with speed ajj^^ and rate function 

p 

I{ai,...,ap) = ^I[t^_^^tj){aj-i - aj), with ao := . 

i=i 

Proof. We note that, for — cxd ^ a'^' < 6^^^ ^ oo, we have (interpreting conditions on the right 
as void, if they involve infinity) 



a'^> a 



n ^ Zi^tj - Ktj < 6'^' Ok for all j) 

(r[0, Ktj + Qf.a'^'^) ^ Ktj,T[0, Ktj + a^b'^''') > ntj for ah j) . 
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To continue from here we need to show that the random variables T[0, Kt+a^b) and T[0, nt)+aj) 
are exponentially equivalent in the sense that 



lim a^^6^MogP( T[0,ft;t + a«,6)-T[0,Kt) - aM > a^e) = -oo . (23) 

Indeed, first let 6 > 0. As in Lemma 4.12, we see that for any t ^ and G M, 

a^^h-^^ \og¥.eii.^{eh^{T[Kt,Kt + aJ))-aJ))] — > 0, (24) 

Chebyshev's inequality gives, for any ^4 > 0, 

P(T[0,«;t + aj)) - r[0, nt) - a^^h > a«e) 

^ g-Aa«6. E exp { f 6« {T[Kt, Kt + a^b) - a^b) } . 

A similar estimate can be performed for ¥{T[0,Kt + a^b) — T[0,Kt) — aJ) < — a^e), and the 

argument also extends to the case 6 < 0. From this (23) readily follows. 

Using Lemma 1.12 and independence, we obtain a large deviation principle for the vector 

[^^{T[ntj-i,Ktj) - K{tj - tj.i)) : iG{l,...,rf), 

with rate function 

p 

Ii{ai, ...,ap) = X]^fe-i.*.-)("i)- 
i=i 
Using the contraction principle, we infer from this a large deviation principle for the vector 

(^^{T[0,Ktj)-Ktj) : je{l,...,p}] 

with rate function 

p 

i=i 
Combining this with (23) we obtain that 

a^^6^^ logP(T[0, Ktj + a^.a'-'^] < Ktj,T[0, Ktj + a^.b'-'^] > ntj for all j) 
~ a^^6^^ logP( - aj}^'^ < r[0, Ktj] - ntj < -a^.a'-''' for all j), 

and (observing the signs!) the required large deviation principle. D 

We may now take a projective limit and arrive at a large deviation principle in the space ^(0, oo) 
of functions x : (0, oo) -^ M equipped with the topology of pointwise convergence. 

Lemma AAA. The family of functions 

^(Z.,-^t):t>0) 

/ K>0 

satisfies a large deviation principle in the space 7^(0,00), with speed ajy^ and rate function 

J, \ _ \ 2 /o°°('^t)^ ti-" dt — - /(O) xq if X is absolutely continuous and xq ^ 0. 
1 oo otherwise. 
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Proof. Observe that the space of functions equipped with the topology of pointwise convergence 
can be interpreted as the projective hmit of M^ with the canonical projections given by 7r(x) = 
(x(ti), . . . ,x(tp)) for < ti < . . . < tp. By the Dawson-Gartner theorem, we obtain a large 
deviation principle with rate function 



p 
I{x)= sup ^/[i^_^,t.)(a;t^._, -xt.) +/[o,ti)(-xti). 

0<ti<...<tp~^ 

Note that the value of the variational expression is nondecreasing, if additional points are added 
to the partition. We first fix ti > and optimize the first summand independently. Observe 
that 

h,-i^j) \^h-i -^tj) = 2 sup 2^ j^^ 1^2^- 

tl<.. ..<,lp ._„ ti<t2<...<tp ._„ 1— a /j. l-a _ J. 1-a \ 

Recall that 

— a l — 2a 1 — 2a —a 



Hence we obtain an upper and [in brackets] lower bound of 

It is easy to see that (using arguments analogous to those given in the last step in the proof of 
the first large deviation principle) that this is +oo if x fails to be absolutely continuous, and 
otherwise it equals 



/•OO 

2 



^ ' {xtft^dt. 



In the latter case we have 



/(x)=limi / (ii)2tT^dt + I[o,i,)(-XiJ. 



If xo > the last summand diverges to infinity. If xq = and the limit of the integral is finite, 
then using Cauchy-Schwarz, 



±tdt ^ i / {xtftT^dt, 
hence it converges to zero. If xq < 0, 

liml[o,io(-^*i)=lim-i/(0)x,, + if^tp(l/(0))2 = -i/(0)xo, 
as required to complete the proof. D 

Lemma 4.15. If c < oo, the function I is a good rate function on £(0, cx)). 
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Proof. Recall that, by the Arzela-Ascoli theorem, it suffices to show that for any rj > the 
family {x: I{x) ^ rj} is bounded and equicontinuous on every compact subset of (0, oo). 

Suppose that I{x) ^ rj and < s < t. Then, using Cauchy-Schwarz in the second step, 



i„ du 



t-t _ , I , rt ^ si 



[ / (i;„)^ «!-« du) M / u 1-" du) ^ ^ Jt] j^ [t i- " - s i-" 



\Xt Xg 



which proves equicontinuity. The boundedness condition follows from this, together with the 
observation that ^ xq ^ — crj/f{0). D 

To move our moderate deviation principle to the topology of uniform convergence on compact 
sets, recall the definition of the mappings /„ from (19). We abbreviate 

Z'^' ■■= {i-AZ^t - Kt) :t>0). 

Lemma 4.16. (/m(-2^''''))meN di"^ exponentially good approximations of (Z'-'^^) on £(0,oo). 

Proof. We need to verify that, denoting by || • || the supremum norm on any compact subset 
of (0, cx)), for every 5 > 0, 



lim limsupa^^6^MogP(||Z("' -/„(Z("')|| > 6) = -oo. 

The crucial step is to establish that, for sufficiently large k, for all j ^ 2, 

sup |Z(«' -Zi;l^\>5)^ 2P(|Zf ' - ZflJ > I). (25) 



To verify (25) we use the stopping time r := inf{t ^ tj_i : \Z\ — Z\ _^ > 5}. Note that 

P(|Zf'-Z«J>|) 



:^ 



ij — l ^t<itj 



sup \zr - zi;^^ I > 6 F{\zi;> - zr' | > | | r ^ t,). 



and, using Chebyshev's inequality in the last step, 

^\zlf - ZlfJ > f I r ^ t,) ^ P(|zf ' - Z^'')] ^ f I r ^ t,) ^ 1 - ^ Var(zJi,^._J. 

1-2q _ , 

As this variance is of order a~ k i-" ^(k)~ -^ 0, the right hand side exceeds ^ foi" sufficiently 
large k, thus proving (25). 

With (25) at our disposal, we observe that, for some integers ni ^ uq ^ 2 depending only on m 
and the chosen compact subset of (0, oo), 

"1 



|Z('=)-/„(Z(«))||>5)^ J^P sup |Z,'-'-Zf'J>5 

^2j;P(|Zf)-Z«J>f). 



j=no 



32 



Hence, we get 

ni 
l: -llL-l 1-_t™/'|I ^ffc-) £ if^iKWW^ ^\ ^ :„r T 



_ _ ^1 

limsupa-i6-ilogP(||Z(-> - /™(Z(«))|| >6)^- inf /[i^_^,,^ 



and the right hand side can be made arbitrarily small by making m = , , — large. D 



tj tj _ 1 



Proof of Theorem 1.12. We apply (Dembo and Zeitouni, 1998, Theorem 4.2.23) to transfer 
the large deviation principle from the topological Hausdorff space ^(0,00) to the metrizable 
space C{0,oo) using the sequence fm of continuous functions. There are two conditions to be 
checked for this, on the one hand that (/m(-Z^*'''))mGN are exponentially good approximations of 
(Z*"'), as verified in Lemma 4.16, on the other hand that 

limsup sup d(/m(x),x) =0, 

for every 77 > 0, where d denotes a suitable metric on £(0, 00). This follows easily from the 
equicontinuity of the set {/(x) ^ r]} established in Lemma 4.15. Hence the proof is complete. D 



5 The vertex with maximal indegree 

In this section we prove Theorem 1.7 and Theorem 1.15. 

5.1 Strong and weak preference: Proof of Theorem 1.7 

The key to the proof is Proposition 5.1 which shows that, in the strong preference case, the 
degree of a fixed vertex can only be surpassed by a finite number of future vertices. The actual 
formulation of the result also contains a useful technical result for the weak preference case. 
Recall that ipt = /q tt-t dv, and let 

t{s) = sup{t £8: 4(pt ^ s}, for s^O. 

Moreover, we let c^oo = lini(-+oo 'ft, which is finite exactly in the strong preference case. In this 
case t{s) = cx) eventually. 

Proposition 5.1. For any fixed f] > 0, almost surely only finitely many of the events 

As := {3t' £ [s,t{s)) nJ : Z[s,t'] ^ t'-r/}, for s e T, 
occur. 

For the proof we identify a family of martingales and then apply the concentration inequality 
for martingales. Lemma A. 3. For s G T, let {T^)ue§ be given hj T^ = u — Tg [0, u) , where Tg [u, v) 
is the time spent by the process Z[s, ■] in the interval [u,v). 
The following lemma is easy to verify. 
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Lemma 5.2. Let (tj)i6Z+ be a strictly increasing sequence of nonnegative numbers with to = 
and liioii^ooti = oo. Moreover, assume that X > is fixed such that AAtj := A (tj — tj-i) ^ 1, 
for all i £ N, and consider a discrete random variable X with 

i-l 

F{X = ti) = XAt^Ylil- XAtj) fori en. 

Then 

E\X] = - and var(X) ^ -^. 

A A^ 

With this at hand, we can identify the martingale property of (T^)ue§- 

Lemma 5.3. For any s G S, the process (Z^)ugs is a martingale with respect to the natural 
filtration (Qu)- Moreover, for two neighbours u < Uj^ in §, one has 

var(7;%|g„)^ 



Proof. Fix two neighbours u < n^ in S and observe that given Q^ (or given the entry time 
Ts[0,tt) + s into state u) the distribution of Ts[u] is as in Lemma 5.2 with A = f{u). Thus the 
lemma implies that 

nTu\Gu] = ^« + y^ - nTs[u] I Qu] = n 

so that (T^) is a martingale. The variance estimate of Lemma 5.2 yields the second assertion. 

D 

Proof of Proposition 5.1. We fix ry ^ l//(0) and uq G S with /(uq) ^ 2. We consider ¥{As) 
for sufficiently large s G T. More precisely, s needs to be large enough such that t{s) ^ uq and 
s — r] — uq ^ \/s/2. We denote by a the first time t in T for which Z[s, t] ^ t — rj, if such a time 
exists, and set a = oo otherwise. 

We now look at realizations for which a £ [s, t{s)) or, equivalently, Ag occurs. We set z^ = Z[s, a]. 
Since the jumps of Z[s, •] are bounded by l//(0) we conclude that 

1^ ^ a-r] + l/f{0) ^ a. 

Conversely, Ts[0, i^) + s is the entry time into state i' and thus equal to a; therefore, 

1/ = Z[s,a] ^ Ts[0,i/) + s - ri, 

and thus T^ = u — TglOju) ^ s — rj. Altogether, we conclude that 

As C {3ue [0,t(s))nS: t^ ^ s-ri}. 

By Lemma 5.3 the process (T^)ug§ is a martingale. Moreover, for consecutive elements u < u^ 
of S that are larger than uq, one has 

var(T„\|g„) = ^, f„%-f„^^^^i and t^ ^ uq. 
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Now we apply the concentration inequality, Lemma A. 3, and obtain, writing Xg = s — i] — uo 
yJ'^'Pt(s) ^ 0, that 

P(^) ^ P( sup t^-^s- ri) 

MG[o,t(s))ns 

^P( sup T;^-t4^s-r?-no) ^2exp( 



where we use that 

ne§n[o,t(s)) -^ ^ ^ 

As V't(s) ^ 5/4, we obtain limsup — - logP(y4s) ^ |. Denoting by i(t) = max[0, t] nT, we finally 
get that 

/>oo 

Y^n^s)^ / e^P(A(s))rfs<oo, 

sGT -^0 

SO that by Borel-Cantelli, almost surely, only finitely many of the events {As)s^t occur. D 

Proof of Theorem 1.7. We first consider the weak preference case and fix s G T. Recall 
that {Z[s, t] — (t — s))t^s and {Z[0, t] — t)t^o are independent and satisfy functional central limit 
theorems (see Theorem 1.6). Thus {Z[s,t] — Z[0,t])t^s also satisfies a central limit theorem, 
i.e. an appropriately scaled version converges weakly to the Wiener process. Since the Wiener 
process changes its sign almost surely for arbitrarily large times, we conclude that Z[s,t] will be 
larger, respectively smaller, than .Z^[0, t] for infinitely many time instances. Therefore, s is not a 
persistent hub, almost surely. This proves the first assertion. 

In the strong preference case recall that ipoo < 00. For fixed ij > 0, almost surely, only finitely 
many of the events {As)seT occur, by Proposition 5.1. Recalling that .Z^[0, t] —t has a finite limit, 
we thus get that almost surely only finitely many degree evolutions overtake the one of the first 
node. It remains to show that the limit points of {Z[s, t] — t) for varying s G T are almost surely 
distinct. But this is an immediate consequence of Proposition 2.2. D 

5.2 The typical evolution of the hub: Proof of Theorem 1.15 

From now on we assume that the attachment rule / is regularly varying with index a < 2, and 
we represent / and / as 

/(n) = u"'i{u) and f{u) = u^^^l{u) for li > 0. 

Moreover, we fix 



K i-a tin 



For this choice of (a^) the moderate deviation principle. Theorem 1.12, leads to the speed (a^), in 
other words the magnitude of the deviation and the speed coincide. The proof of Theorem 1.15 
is based on the following lemma. 

Lemma 5.4. Fix ^ u < v and define !« as I^ = T f] [a^u, a^v). Then, for all e > 0, 



lim P(max2'[s, k\ ^ k + a^ 



-^+vf^^-^'-^+vfri^+^ 
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1. 



Proof. Our aim is to analyze the random variable max^gi^ Z[s, n] for large k. We fix (" ^ — u 
and observe that 



''(maxZ[s, k] < K + a^C) = TT ^{Z[s, k] < k + a^C) 



sells 

f ^ P(^[s,nax, k] < K + a,C)*^'= = IP(Ts_ [0, K + a«C) + Smax > k)#^^ 

where Smin and Smax denote the minimal and maximal element of I^. 

Next, we observe that limK^oo •Smax/oK = v and lim^^oo Smin/aK = u- Consequently, we can 

deduce from the moderate deviation principle, Lemma 4.12, together with Lemma 4.2, that 

logP(r,_[0, K + a«C) + «max ^ k) = log p( ^-- ["' ^ + "^^^ " ^ " "^^ ^ _ £H12£ _ ^) 

11 -2a ^ ' 



-aKl[o,i){-v - C) = -Ok^^^j — ^(w + C)^ 
^ ' ' 2 1 — a 



and analogously that 



logP(Ts [0,«; + aKC) + Smin ^ k) ~ -Ok--; (i^ + C)^- 

2 L — a 



2-2a 



V. 



Next we prove that P(maxsg]i^ Z[s, k] < k + OrC) tends to when C, < —v + -\/y_2q,> 

If (" < —u, then the statement is trivial since by the moderate deviation principle P(Z[smin, k] < 

n + QkC) tends to zero. Thus we can assume that ^ ^ — u. By (26) one has 

F{maxZ[s,K]<K + a^C) ^ exp{ #I« log (l - P(r,_JO, k + a«C) + Smax ^ /«))}• 

and it suffices to show that the term in the exponential tends to — cx) in order to prove the 
assertion. The term satisfies 

#1, log(l - P(T,_ [0, K + a«C) + Smax ^ Z^)) 

~ -#I« P(r,_JO, K + a«C) + Smax ^ k) 

= - exp|a« \— log #I« + — log F{Ts^^^ [0, k + a«C) + Smax ^ /t)! | • 



Since — log ^I^ converges to f , we conclude with (27) that 

lim c^=v-^{v + Cf. 

Now elementary calculus implies that the limit is bigger than by choice of <^. This implies the 
first part of the assertion. 



It remains to prove that P(maxseis Z[s, k] < k + QkC) tends to 1 for C > —u + y f^rf^^- Now 
P(maxZ[s,K] <K + a^C) > exp|#I«log (l - P(r,^;JO, k + a^C) + ^mm ^ ft))) 
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and it suffices to show that the expression in the exponential tends to 0. As above we conclude 
that 

#1, log(l - P(T,^iJO, K + a«C) + Smin ^ k)) 

~ - exp(a« [— log #I« + — logP(r,^;JO, k + a^Q + Smin ^i^)])- 



lim c« = z; - iflf (tz + 0' 



We find convergence 

liTn n — l^ — 

_ 2-2a 

and (as elementary calculus shows) the limit is negative by choice of C,. D 

For s G T and k > we denote by Z'''"'^' = {Z^ )t ^o the random evolution given by 

v(«.-) _ Z[S,S + Kt] - Kt 

^t — • 

Ok 

Moreover, we let 



^ = i^t)t^o = {^{t"^ M)) ^ 



t >0 

Proof of Theorem 1.15. 1st Part: By Lemma 5.4 the maximal indegree is related to the 
unimodal function h defined by 



h{u) = -u + yj^u, for u^O. 

h attains its unique maximum in limax = ^jr^ a-iid h{u^^s.x) = Umax- We fix c > ^jE^i let 
C, = max[/i(nmax) — h{umax i e)] and decompose the set [0, Umax — e) U [umax + £, c) into finitely 
many disjoint intervals [ui,Vi) i £ I, with mesh smaller than (/3. Then for the hub s* at time 
K > one has 

P(s* G a«:[Umax " £, "Umax + e)) 



^ Pf max Z[s, k]^ K. + a^{h{u,^^^) - C/3) 

VseaK[Umax— e,Mmax)nT 

xfTpf max Z[s,K]i^K + a^{h{vi) + C/2)) (2^) 

-'■-'■ \seaJui,Vi)nT J 

X P( max Z[s, kI ^ k 

\se[ca«, oo)nT 

By Lemma 5.4 the terms in the first two lines on the right terms converge to 1. Moreover, by 
Proposition 5.1 the third term converges to 1, if for all sufficiently large k and k+ = min[«;, oo)n§, 
one has 499^^ ^ ca^^. This is indeed the case, since one has K4. ^ k + /(O)^^ so that by 
Lemma A.l, 4c^«;+ ~ 4 ^Z^ol "^k- '^'^^ statement on the size of the maximal indegree is now an 
immediate consequence of Lemma 5.4. 

2nd Part: We now prove that (an appropriately scaled version of) the evolution of a hub typically 
lies in an open neighbourhood around z. 
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Let U denote an open set in £(0, oo) that includes z and denote by V^ its complement in £(0, oo). 
Furthermore, we set 

As = \x e C{0, oo) : max Xf ^ 2(umax - e) [ 

for e ^ 0. We start by showing that z is the unique minimizer of / on the set Aq. Indeed, 
applying the inverse Holder inequality gives, for x £ Aq with finite rate I{x), 

i{x)-^\j ±it^dt^\n \xt\dtf{f t-^dt) ^ ^i^=um^^=i{z) 



2 l-2a 
' 



Moreover, one of the three inequalities is a strict inequality when x ^ z. Recall that, by 
Lemma 4.15, / has compact level sets. We first assume that one of the entries in f7^ n Aq 
has finite rate /. Since U'^ D Aq is closed, we conclude that / attains its infimum on U^ f) Aq. 
Therefore, 

/(?7^ n Aq) := mi{I{x) : x e U"" n Aq} > I{z) = u^ax- 

Conversely, using again compactness of the level sets, gives 

\\niI{U^r\Ae) = I{U^r\AQ). 

Therefore, there exists e > such that I[U^ n A^,) > I{z). Certainly, this is also true if V^ 
contains no element of finite rate. 

From the moderate deviation principle. Theorem 1.12, together with the uniformity in s, see Propo- 
sition 4.4, we infer that 

limsup — maxlogP(Z(''''' G U" r\ A^) ^ -I{U''r\Ae) < -I{z). (29) 

It remains to show that V{Z^'^''^ G V^) converges to zero. For e > and sufficiently large k, 

P(Z^-" G U') ^ P« a«Kax - e,n„,ax + e]) 

+ P( max Zl'^''^ ^ 2(u,max - e), s*^ £ aK[umax - £, itmax + e]) 

te[|,i] 

+ P(^<''' G U", max zf^'^ ^ 2(nmax - e), «« G a^[u„,^^ - e, w^ax + e]) . 

te[ii] 

By the first part of the proof the first and second term in the last equation tend to for any 
e > 0. The last term can be estimated as follows 

p(Z«-« G U', Zf-^^ ^ 2(u^ax - e), < G a,[u^ax - e, n^ax + e]) 

seTnaK[Umax-e,Mmax+e] 

Moreover, log ^^(T n a^lu^^x — £, Umax + e]) ~ CLuiuranx + £)■ Since, for sufficiently small e > 0, 
we have I{U'^ n A^) > u^nax + e we infer from (29) that the sum in (30) goes to zero. D 
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A Appendix 

A.l Regularly varying attachment rules 

In the following we assume that /: [0, cxd) -^ (0, oo) is a regularly varying attachment rule with 
index a < 1, and represent / as f{u) = u"'i{u), for u > 0, with a slowly varying function i. 



Lemma A.l. 



1. One has 



^(u) 



1 u 



l-a 



1 - a i(u) 



as u tends to infinity and f admits the representation 

f[u) = / o (^^^{u) = u~^^^£{u), for u> 0, 

where i is again a slowly varying function. 
2. If additionally a < ^, then 



Vu 



1 



fin 



■ du 



1 



l-2a 

a u i-« 



l-2a i{u) 



Proof. The results follow from the theory of regularly variation, and we briefly quote the 
relevant results taken from Bingham et al. (1987). The asymptotic formula for ^ is an immediate 
consequence of Karamata's theorem, Theorem 1.5.11. Moreover, by Theorem 1.5.12, the inverse 
of <1> is regularly varying with index (1 — a)~^ so that, by Proposition 1.5.7, the composition 
/ = /o$^^ is regularly varying with index j^. The asymptotic statement about if follows 
again by Karamata's theorem. D 

Remark A. 2. In the particular case where f{u) ~ cu", we obtain 

^{u) ~ ^^j^ u^-", ^-^{u) ~ (c(l - a)u)^ 



and 



- 1 , , " 

f{u) ~ ci-" ((1 - a)u) ^-" . 



A. 2 Two concentration inequalities for martingales 

Lemma A. 3. Let {Mn)neZ+ be a martingale for its canonical filtration {J-n)n<^'L+ with Mq = 0. 
We assume that there are deterministic cj„ G M and M < oo such that almost surely 

• var(M„|.Fn-i) ^ cj^ and 

• Mn- Mn-i ^ M. 

Then, for any A > and m G N, 



\2 
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Proof. Let r denote the first time n G N for whicli M„ ^ A + \/2T^n^a^- Tlien 

m 

P(M™ ^ A) ^ J^ P(t = n) p(m„ - M„ ^ 



n=l 



^^s 



o",- T = n . 



Next, observe that var(Mm — M„ | r = n) ^ Z^I^n+i ^i^ ^o that by Chebyshev's inequahty 



Mm-Mn-^ 






On the other hand, a concentration inequality of Azuma type gives 

/ A^ 
P(M„ ^ A) ^ exp --^^..^ 

(see for instance Chung and Lu (2006), Theorem 2.21). Combining these estimates immediately 
proves the assertion of the lemma. D 

Similarly, one can use the classical Azuma-Hoeffding inequality to prove the following concen- 
tration inequality. 

Lemma A. 4. Let {Mn)ne'L+ be a martingale such that almost surely |M„ — M„_i| ^ c„ for 
given sequence (c„)„gN- Then for any A > and m G N 



sup|M„-Mo|^A+ 2Vc2) ^4exp(--=^^^ j). 
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